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Abstract 

Background: Recent engineering education research has found improved 
learning outcomes when instructors engage students actively (e.g., through 
practice problems) rather than passively (e.g., in lectures). As more instructors 
shift toward active learning, research needs to identify how different types of 
activities affect students’ cognitive engagement with concepts in the classroom. 
In this study, we investigate the effects of prompting novice students to draw 
when solving problems, a professional practice of engineers. 

Purpose: We investigate whether implementing instructional prompts to draw 
in an active learning classroom (a) increases students’ use and value of drawing 
as a problem-solving strategy and (b) enhances students’ problem-solving 
performance. 

Method: We compared survey data and exam scores collected in one 
undergraduate class that received prompts to draw in video lectures and in- 
class problems (drawing condition) and one class that received no drawing 
prompts (control condition). 

Results: After drawing prompts were implemented, students’ use and value of 
drawing increased, and these effects persisted to the end of the semester. Stu- 
dents were more likely to draw when provided drawing prompts. Furthermore, 
students who received prompts outperformed students who did not on exam 
questions that target conceptual understanding. 

Conclusions: Our findings reveal how implementing drawing prompts in an 
active learning classroom may help students engage in drawing and solve 
problems conceptually. This study contributes to our understanding of what 
types of active learning activities can improve instructional practices in engi- 
neering education. Particularly, we show how prompts that foster authentic 
engineering practices can increase cognitive engagement in introductory-level 


engineering courses. 
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1 | INTRODUCTION 


Recent engineering education research has advocated for instructors to implement active learning activities that pro- 
mote “hands-on” and “minds-on” engagement with content in contrast to traditional lectures where students listen pas- 
sively (Chi & Wylie, 2014; Freeman et al., 2014). Much evidence in engineering education has shown that active 
learning activities are more effective than passive activities, but prior work has not focused on how and when specific 
types of activities are most effective (Streveler & Menekse, 2017). 

One common approach to promote active learning in engineering is to focus class time on solving practice problems 
through reducing in-person lectures or replacing them with video lectures (Bishop & Verleger, 2013; Kerr, 2015). This approach 
allows students to solve problems with the support of instructors and peers in the classroom instead of listening passively to a 
lecture. Some evidence has shown that this method of reducing lectures can increase student performance on exams or grades 
in engineering classrooms (Kerr, 2015; Lo & Hew, 2019). However, much of this work does not identify which activities are 
most effective, particularly toward enhancing students’ conceptual understanding (Bishop & Verleger, 2013; Kerr, 2015). 

It is important to understand how active learning classrooms can support conceptual understanding because only 
focusing on practice problems in the classroom may encourage students to engage in ineffective problem-solving strate- 
gies that rely too strongly on procedural knowledge. Particularly in introductory-level engineering courses, students 
tend to solve problems procedurally using a “plug-and-chug” or “trial-and-error” method in which they immediately 
apply a formula or algorithm to given problems (Bergqvist, 2007; Lithner, 2003). This process tends to be a purely 
mechanical procedure of symbol and number manipulation. In so doing, they may not engage with the underlying con- 
cepts (Bergsten, Engelbrecht, & Kagesten, 2017; Higley, Litzinger, Van Meter, & Masters, 2007; Leppavirta, Kettunen, & 
Sihvola, 2011). Furthermore, students may not develop the professional practices of engineers who engage in concep- 
tual problem solving (de Vere, Melles, & Kapoor, 2011; McCracken & Newstetter, 2001). 

When engineers solve problems, prior research shows that they first translate problems into visual-spatial drawings 
that help them qualitatively “see” and reason with concepts (Cardella, Atman, & Adams, 2006; McCracken & 
Newstetter, 2001; Vale, Pimentel, & Barbosa, 2018). The drawings serve as a model of the problem and depict how the 
underlying concepts relate to one another (Kothiyal, Murthy, & Chandrasekharan, 2016; Schwarz et al., 2009). Then, 
engineers review and evaluate their drawings by quantitatively applying formulas or using a calculation tool to deter- 
mine numerical parameters, which then helps them revise their drawings. Studies with engineers consistently show 
that they engage in this visual problem-solving strategy rapidly and flexibly to align with the specific problem they are 
solving (Kothiyal et al., 2016; McCracken & Newstetter, 2001). However, studies with students show that senior 
engineering students engage in this strategy and view it as valuable, but novice students often do not (McNeill, Douglas, 
Koro-Ljungberg, Therriault, & Krause, 2016). Novice students may not choose to engage in drawing as a problem-solving 
strategy if they often prefer to use the plug-and-chug method in engineering courses. 

This study addresses the gap between professional engineers and novice students in problem-solving strategies by 
leveraging prior research in cognitive sciences. This research shows that novice students may struggle to draw without 
instructional support (Leutner & Schmeck, 2014; Van Meter & Garner, 2005). Hence, we provided instructional support 
via drawing prompts, which are instructional prompts (e.g., text presented under a problem) that ask students to draw 
freehand, typically with pen and paper (Leutner & Schmeck, 2014; Prain & Tytler, 2012). Prior research suggests that 
drawing prompts can help students make connections among concepts when solving problems and achieve higher 
levels of understanding (Fan, 2015; Wu & Rau, 2018). In engineering research, short-term studies with interviews and 
in workshops show that drawing prompts are effective in helping engineering students engage with conceptual relation- 
ships and solve problems (de Vere et al., 2011; McNeill et al., 2016). However, prior work has not tested whether 
drawing prompts can promote active learning and conceptual problem solving in a semester-long engineering 
classroom, such that they counteract students’ preferred plug-and-chug method. 

We address this gap by conducting a quasi-experimental study in two offerings of a semester-long active learning course 
for undergraduate engineering students. We implemented drawing prompts in one course and compared differences 
between the courses on students’ (a) perceptions of drawing as a problem-solving strategy and (b) exam performance. We 
investigate the effects of drawing prompts to provide insight into whether drawing prompts can enhance active learning 
activities in the engineering classroom and help novice students draw to solve problems as professionals do. 

In the following, we briefly review prior research on how students engage with different active learning activities 
and how drawing may help novice engineering students solve problems conceptually. Then, we discuss how instructors 
can implement drawing prompts to enhance active learning activities and facilitate conceptual problem solving in their 
classrooms. 
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1.1 | Howstudents engage with active learning activities in engineering courses 


One key goal of this study is to identify how and when specific types of active learning activities are effective for 
students in an authentic engineering classroom. To this end, we differentiate activities using the interactive-construc- 
tive-active-passive (ICAP) framework as suggested by engineering education researchers (Streveler & Menekse, 2017). 
The ICAP framework suggests that higher learning outcomes are associated with higher levels of cognitive engagement, 
which increase from passive to active to constructive to interactive activities (Wylie & Chi, 2014). Passive activities (e.g., 
lectures, videos) may not engage students cognitively. Active activities (e.g., highlighting, transcribing) help students 
physically interact with concepts but may not cognitively engage students. Constructive activities (e.g., making concept 
maps, summarizing) increase cognitive engagement because students must make connections and construct their own 
knowledge. Interactive activities (e.g., discussions, collaborative projects) further increase cognitive engagement 
because students construct ideas using input and feedback from others, which creates deeper cognitive connections to 
concepts. Prior work in engineering education has not differentiated between active, constructive, and interactive levels 
of engagement, research which may explain differences in learning outcomes between specific types of activities 
implemented in the classroom (Streveler & Menekse, 2017). 

In the engineering classroom, students often learn content by solving practice problems, which may only engage 
them actively. Particularly in the introductory-level courses, students are expected to learn concepts and formulas by 
solving simplified problems with specified constraints and singular goals (McNeill et al., 2016). These types of problems, 
also called “well-structured problems” or “classroom problems,” are easy to solve by identifying the givens of the 
problem, finding a formula that involves those givens, and plugging in the givens to find the numerical solution. 
Because the formulas are typically provided or derived for students, they do not have to constructively organize and 
relate the underlying concepts but can actively plug-and-chug numbers. However, students who engage actively with 
concepts when problem solving may only gain procedural knowledge, but not conceptual understanding (McNeill 
et al., 2016; Streveler, Litzinger, Miller, & Steif, 2008). 

To develop conceptual understanding, students may need active learning activities that increase cognitive engagement, 
such as drawing. Prior research shows that drawing can enhance students’ conceptual understanding because it engages 
higher-order thinking (e.g., elaboration, synthesis, and integration of concepts; Leutner & Schmeck, 2014; Van Meter & 
Garner, 2005). When students generate drawings, they must select, organize, and integrate relevant features into a 
coherent form (Van Meter & Firetto, 2013; Van Meter & Garner, 2005). In this process, students must determine how con- 
cepts are related structurally or analogically (e.g., real and imaginary components are two perpendicularly related dimen- 
sions, like x and y on x-y axes). Importantly, they must specify how they understand these relationships in an externally 
generated representation (Kavakli & Gero, 2001; Tversky, 2011). The generated drawings then allow students to reflect, 
revise, and further explore related visual-spatial concepts (Bobek & Tversky, 2016; Cardella et al., 2006). 

In accordance with the ICAP framework, drawing can engage students constructively or interactively. As an 
individual activity, drawing helps students constructively engage in higher-order thinking about how visual-spatial 
concepts relate. As a collaborative activity, drawing helps students interactively engage with others in their classroom 
(White & Pea, 2011; Zhang & Linn, 2011). When students draw, they generate external drawings that serve as shared 
artifacts for students to discuss (White & Pea, 2011). Students who discuss their drawings may realize that they hold 
divergent views, which can prompt them to clarify relationships between features in their drawings and engage more 
deeply in making sense of the underlying concepts (Johri, Roth, & Olds, 2013; White & Pea, 2011; Zhang & Linn, 2011). 
After discussing and comparing their drawings, students may revise their drawings to be more clear, parsimonious, and 
explanatory representations of the concepts they depict (Greeno & Hall, 1997; Nathan, Eilam, & Kim, 2007). Through 
this process, students may also learn how to use drawing as a communication tool in a way that resembles professional 
practices (McCracken & Newstetter, 2001; Ullman, Wood, & Craig, 1990). 


1.2 | Challenges for drawing as an instructional practice in engineering education 


Although drawing is a valued professional practice, current instructional practices in undergraduate engineering, par- 
ticularly in introductory-level courses, typically do not focus on drawing as a problem-solving strategy to reason with 
concepts. Rather, engineering courses have been found to overly emphasize quantitative skills and algorithmic thinking 
(Litzinger et al., 2011; Nelson Laird, Shoup, Kuh, & Schwarz, 2008). In such courses, engineering instructors help stu- 
dents build a foundation of knowledge by defining relevant concepts, deriving formulas, and demonstrating how to 
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apply formulas to solve well-structured problems that target specific concepts (Litzinger et al., 2011; Streveler et al., 2008). 
Students can excel in these courses by memorizing and applying formulas procedurally on exams or homework problems 
(Bergqvist, 2007; Lithner, 2003). Consequently, students may emerge from introductory-level courses without an under- 
standing of how underlying concepts relate to one another or develop the problem-solving strategies used by professionals. 

Engineering education research suggests shifting instructional practices to focus on a minimal-mathematical 
approach that relies on drawings and other visuals. This approach helps students engage with the underlying concepts 
and gain insight into the relationships between concepts as professionals do (Bergsten et al., 2017; Otung, 2001). In line 
with this work, mathematics education research has found that visual-spatial representation of problems can enhance 
conceptual problem solving (Rittle-Johnson, Siegler, & Alibali, 2001). However, little research has investigated how to 
support drawing in the undergraduate engineering classroom as a means to promote conceptual problem solving 
(Litzinger et al., 2011; Streveler et al., 2008). 

Furthermore, prior research shows that engineering instructors ask students to draw in order to visualize and 
communicate ideas in engineering (McNeill et al., 2016), but novice students often do not draw to solve problems 
(Atman, Cardella, Turns, & Adams, 2005). When novice engineering students solve well-structured classroom prob- 
lems, they tend to choose nonvisual, algebraic strategies even when instructors believe drawing would be more useful 
(Presmeg, 2014; Vale et al., 2018). Students may choose such strategies because they require less cognitive effort and 
may reduce time spent on problems (Bergqvist, 2007). This preference for procedural problem solving may be particu- 
larly prevalent in a classroom setting where students focus on completing practice problems within a limited time. 
Hence, students in introductory-level courses may require more explicit support from instructors to engage in drawing 
and other types of active learning activities that increase cognitive engagement (Van Meter et al., 2016). 


1.3. | Howto implement drawing prompts that help students engage in drawing 


In this study, we combine prior research on active learning with research on problem-solving to develop instructional 
practices that engage students in drawing to solve well-structured problems in an introductory-level engineering class- 
room. First, we use the ICAP framework to identify practice problems as an activity that may only promote active 
engagement and drawing as an activity that promotes constructive and interactive engagement. Second, we use prior 
research on problem solving to differentiate between formulaic plug-and-chug methods as a procedural problem- 
solving strategy that may only enhance procedural knowledge and drawing as a conceptual problem-solving strategy 
that may enhance conceptual understanding. Taken together, this suggests that supporting drawing as an instructional 
practice may increase cognitive engagement and promote conceptual problem solving. 

Because we identified several challenges to drawing as an instructional practice above, we reviewed research in 
education and cognitive sciences to identify instructional practices that can help students engage conceptually in 
drawing. Below, we propose two levels in which these are implemented through drawing prompts. 

First, prior work shows that students require support to “see” concepts in drawings as professionals do (Vale 
et al., 2018). When solving problems in engineering, students tend to fixate on one aspect of the problem and fail to iden- 
tify all relevant pieces of information (Douglas, Koro-Ljungberg, McNeill, Malcolm, & Therriault, 2012; Kumsaikaew, 
Jackman, & Dark, 2006). Hence, when drawing, students overly focus on irrelevant features and not on the underlying 
relationships between relevant features (Jee et al., 2014; Van Meter & Firetto, 2013). However, instructors often do not 
explain how to distinguish relevant features from irrelevant or aesthetic features, or how to use relevant features for con- 
ceptual problem solving (Fiorella & Mayer, 2016; Valanides, Efthymiou, & Angeli, 2013). Thus, we provided drawing pro- 
mpts in video lectures that model professional practice by providing specific cues regarding what features to draw 
(e.g., labeled axes and patterns) and how to “read” their drawings to “see” underlying concepts and solve a problem 
(e.g., extrapolate a trend and predict a resultant). Such drawing prompts can demonstrate how to use drawings and why it 
is effective for specific problems so that students use their drawings effectively as a problem-solving strategy. 

Second, prior research shows that students do not draw spontaneously unless repeatedly prompted to do so 
(Uesaka & Manalo, 2012; Wu & Rau, 2018). Because students often choose nonvisual strategies (Presmeg, 2014; Vale 
et al., 2018), they need additional guidance on when to use drawing as a problem-solving strategy and what relevant 
information to focus on in their drawing (Leutner & Schmeck, 2014; Uesaka & Manalo, 2012). Thus, we also provided 
drawing prompts that target specific problems to help students generate a drawing that depicts the underlying concepts 
and relationships. Such prompts can help them determine when to use drawing as a problem-solving strategy and what 
to draw for specific problems. 
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Our brief review of active learning activities and problem solving in introductory-level engineering classrooms 
identified drawing as an instructional practice that can increase students’ cognitive engagement and promote concep- 
tual problem-solving strategies used by professional engineers. However, prior work in engineering has only investi- 
gated drawing prompts in interview studies (Douglas et al., 2012; McNeill et al., 2016), not in a semester-long active 
learning classroom in which students solve well-structured problems to learn concepts. Thus, our goal is to investigate 
the effects of drawing prompts in the context of a realistic engineering class. Specifically, we investigate the effects of 
drawing prompts in an active learning classroom on students’ (a) use and value of drawing and (b) exam performance. 

First, we investigate whether providing drawing prompts as an instructional practice will help students use and 
value drawing as a problem-solving strategy because novice students often do not draw to solve problems as profes- 
sionals do (Cardella et al., 2006; McCracken & Newstetter, 2001). Because we designed the prompts to help students 
determine how, why, when, and what to draw, we expect this instructional practice to affect students’ engagement in 
drawing as a problem-solving strategy (Fan, 2015; Uesaka & Manalo, 2012). Specifically, we investigate: 


RQla: Do drawing prompts affect students’ use of drawing as a problem-solving strategy throughout the 
active learning 

course? 
RQ1b: Do drawing prompts affect students’ perceived value of drawing as a problem-solving strategy throughout the 
active learning course? 

Exploratory question 1c: How do drawing prompts on specific practice problems affect students’ use of drawing on 

those 

problems? 


Furthermore, we investigate whether providing drawing prompts in a classroom context affects students’ exam 
performance on problems that rely on conceptual understanding. Prior work suggests that students may gain a deeper 
conceptual understanding because drawing helps professionals and senior engineering students engage with the under- 
lying concepts (Cardella et al., 2006; McCracken & Newstetter, 2001; Vale et al., 2018). However, novice students may 
not engage in drawing conceptually as professionals do. Hence, we investigate: 


RQ2a: Do drawing prompts affect students’ performance on exam questions that assess conceptual understanding? 


We also investigated whether drawing prompts affect students’ procedural knowledge. Although we draw upon 
prior research to design drawing prompts that increase cognitive engagement, students may choose to draw actively. 
That is, they may procedurally follow instructions to draw relevant features but use nonvisual strategies (e.g., formulas) 
and solve problems conceptually by “reading” or “seeing” relationships in the drawing. Furthermore, because prior 
work shows that drawing particularly targets higher-order thinking and increases students’ cognitive engagement with 
content (Leutner & Schmeck, 2014; Van Meter & Garner, 2005), we do not know how drawing will affect students’ 
procedural knowledge. Hence, we also investigate: 


RQ2b: Do drawing prompts affect students’ performance on exam questions that assess procedural knowledge? 


2 | METHOD 
2.1 | Experimental design and study setting 


To investigate our hypotheses, we conducted a quasi-experimental study with a class in Spring 2018 (nm = 129 students) 
that received drawing prompts (drawing condition) and a class in Fall 2017 (n = 189 students) that did not receive pro- 
mpts (business-as-usual control condition). The larger class size in Fall 2017 resulted from limited enrollment capacity 
in the prior semester due to the availability of classrooms. No students repeated the course (i.e., were included in both 
the drawing and control conditions). 
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All students were enrolled in an introductory-level electrical engineering course on signal processing at a large 
U.S. Midwestern university. The course was held in a technology-enhanced classroom with laptop computers, TV moni- 
tors, whiteboards, and tables that seat three to six students. The course was designed as a “flipped” active learning class- 
room. Prior to class, students watched video lectures and completed a comprehension quiz about the lecture. During 
the class periods, students solved engineering problems in an educational technology as described below. 


2.2 | Materials 
2.2.1 | Educational technology 


In each class period, students in both conditions used an educational technology to complete a problem set on an 
electrical engineering topic that was covered in the video lectures. Each problem set included 25 problems on average, 
for a total of 590 problems over the semester. For each problem, students entered a numerical answer and received cor- 
rectness feedback for up to three attempts (see Figure 1 for an example problem). Students were encouraged to work 
with peers at their table to solve the problems or ask for help from the instructional team (instructor, teaching assistant, 
and three undergraduate peer coaches) who floated around the classroom. 


2.2.2. | Drawing prompts 


For students in the drawing condition, we made two changes to the course materials in accordance with the 
instructional practices discussed above. First, the instructor created new video lectures that focus on drawing. He dem- 
onstrated how professionals draw to “see” concepts and solve specific engineering problems. Furthermore, he encour- 
aged students to draw when they solve similar problems and emphasized how “drawing graphical representations is 
very useful” in both written text and speech. By contrast, students in the control condition watched video lectures that 
focused on formulas. The instructor demonstrated how to derive and apply formulas to solve engineering problems 
without demonstrating or encouraging students to draw when solving problems. Appendix A shows example 
screenshots from video lectures for both conditions. 

Second, we added drawing prompts to specific in-class problems, as shown inside the green box in Figure 1. Each 
drawing prompt immediately followed the problem text and asked students to draw a graph using the specific informa- 
tion provided in the problem. Furthermore, it asked students to share their drawings with peers and discuss how to 
solve the problem, which aimed to engage students with concepts interactively and encourage the use of drawings 
(Uesaka & Manalo, 2012). 

We only added specific drawing prompts to 14 of the total 590 in-class problems (1 prompt in Class 2, 8 in Class 4, and 
8 in Class 6). We selected these problems based on log data from the previous semester showing poor student performance 
as well as classroom observations showing that the instructional team used drawings to explain these problems when 
answering student questions one-on-one. Each problem targeted foundational concepts that help students depict electrical 
signals and build on mathematics concepts typically taught in high school: trigonometric functions (Classes 2 and 6) and 
complex numbers (Class 4). Because these are foundational concepts, students must use them to solve problems in later 
class periods and in future courses. In particular, Mercorelli (2015) and Meyer and Land (2003) refer to complex numbers 
as a threshold concept in engineering that may lead to troublesome knowledge for future courses. While prior engineering 


A sinusoidal signal takes on the value 0.5 at times ¢ = 0.1, 4.6, 5.1, 9.6, 10.1, 14.6, 15.1, ... ms. Find the frequency of the signal in Hz 


This problem is more difficult than it looks. Draw a graph with these points and attempt to find a sinusoid that includes them. Compare your graph with 


another student and discuss a strategy to find the frequency given these time samples. 


Answer: 


Check 


FIGURE 1 _ Example in-class problem with a prompt to draw in the rectangle [Color figure can be viewed at wileyonlinelibrary.com] 
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research has sought to help students learn these foundational concepts through instruction focused on graphs, diagrams, 
and other visuals (Mercorelli, 2015; Shearman, Hong, & Pérez, 2009), it has not examined the effects of prompting stu- 
dents to draw when learning these concepts. 


2.3. | Assessments 
2.3.1 | Surveys 


We assessed RQ1a and RQ1b using survey questions that asked students to rate on a 5-point scale how often they used 
drawing to solve problems in this class (1 = never, 5 = 3 or more times a week) and how much they valued drawing as 
a problem-solving strategy (1 = not valuable at all, 5 = extremely valuable), among other strategies. We also asked for 
demographic information about students’ major, year in school, gender, prior math courses taken, and prior experience 
in a flipped classroom. 


2.3.2 | Strategy checkbox 


We further assessed students’ use of drawing to explore Qilc by embedding checkbox questions that asked students in 
the drawing condition how they solved (a) problems with drawing prompts or (b) problems in which the instructor 
expected students to solve the problem with drawing. As shown in Figure 2, students selected all that apply from four 
strategies: applying a formula, drawing, using a calculation/computational tool, or another strategy. 


2.3.3 | Exams 


We assessed RQ2a and RQ2b using students’ exam performance on conceptual understanding or procedural knowledge. 
The instructor first identified 33 exam questions that assessed students’ understanding of underlying visual-spatial con- 
cepts. We then identified 39 exam questions that assessed procedural knowledge such as definitions and use of formulas 
(see Appendix B for examples of conceptual and procedural exam questions). Each set of questions was highly reliable 
(Cronbach's a = .796 and .847, respectively). 


2.4 | Procedure 


As shown in Table 1, students in both conditions met for 26 class periods over the semester. We conducted one survey 
in Class 25 near the end of the semester for students in the control condition. For students in the drawing condition, 
we conducted surveys at three time points: a pre-survey in Class 1, a mid-survey in Class 9, and a post-survey in Class 
25 to match the timing of the survey in the control condition. All surveys were voluntary, but students received class 
time to complete them. For the post-survey in the drawing condition, the instructor offered one point toward students’ 
final grade to increase the response rate. 

Furthermore, recall that students in the drawing condition received drawing prompts during video lectures and 
14 prompts during in-class problems presented early in the semester as described previously. Table 1 shows when stu- 
dents in the drawing condition received drawing prompts during in-class problems and responded to strategy checkbox 
questions in Classes 4, 5, and 6. 

In addition, students in both conditions received seven drawing prompts during the in-class problems in Class 
18, near the end of the semester. These drawing prompts were designed by the instructor prior to the study. They were 
provided for problems on convolution, a difficult concept that requires a visual strategy (Buck et al., 2005). For students 
in the drawing condition, we added a self-report strategy checkbox question after these prompts. 


3 | RESULTS 
3.1 | Prior manipulation checks 
Because students are not randomly assigned to conditions in quasi-experiments, we examined prior differences in 


demographics between conditions. Demographics were not normally distributed (see Table 2 for descriptive statistics). 
Therefore, we conducted Mann-Whitney tests with condition as the independent factor and students’ major (electrical/ 
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computer engineering majors vs. nonmajors), year in school, gender, number of prior math courses, and prior experi- 
ence in a flipped classroom (flipped experience) as the dependent measure, with the results showing significant differ- 
ences only between conditions in year, U = 13,370, p< .000, and flipped experience, U = 8,745, p = .020. As shown in 
Table 2, students in the control condition had more years in school and less prior experience in a flipped class, com- 
pared to students in the drawing condition. We also conducted a correlation analysis that showed year and flipped expe- 
rience were not correlated with exam performance or survey responses, p < .05. 

Next, we checked for differences in students with missing survey data (n = 19 in the control condition and n = 23 
in the drawing condition). Mann-Whitney tests showed no significant differences between students with and without 
missing data on students’ reported value of drawing, demographics, or exam performance, p > .05. However, there were 
significant differences on condition, U = 5,623, p = .026, and on reported use of drawing, U = 3,277, p = .028. That is, 
students in the control condition and students who reported lower drawing use were more likely to have missing data. 


3.2 | Differences in use and value of drawing as a problem-solving strategy 


Because drawing prompts only guided students on how and when to draw, we investigated whether drawing prompts 
affected students’ use (RQ/a) and value of drawing (RQIb). For both research questions, we first compared differences 
between the two conditions for students who responded to the survey in the control condition (nm = 173; 92.0%) and stu- 
dents who responded to the post-survey in the drawing condition (mn = 124; 96.1%). Recall that both surveys were con- 
ducted at the end of the semester in Class 25. Then, we compared differences over time for the students in the drawing 
condition who completed all three surveys (n = 106; 82.2%). See Figures 3 and 4 for a summary of students’ reported 
drawing use and value, respectively. 

To investigate RQJa (whether prompts affect students’ use of drawing), we first compared reported drawing use 
between conditions using a Mann-Whitney test because survey results were not normally distributed (Figure 3). Results 
showed a higher frequency of drawing use, U = 9,076, p = .018, for the drawing condition (M = 3.895, SD = 0.909) 
than the control condition (M = 3.572, SD = 1.068). Second, we compared differences over time for students in the 
drawing condition. A repeated-measures ANOVA with survey time (pre-survey, mid-survey, and post-survey) as the 
independent factor and reported drawing use as dependent measures showed a main effect of drawing use, F(2, 
210) = 23.314, p<.001, ea = .182. Compared to the pre-survey (M = 3.104, SD = 1.077), students reported drawing 
more at the mid-survey (VM = 3.821, SD = 1.058) and post-survey (M = 3.840, SD = 0.907). Hence, in regard to RQ1a, 
we found that students in the drawing condition were more likely to use drawing on a regular basis after receiving 
drawing prompts compared to their use of drawing before prompts and compared to students in the control group. 

To investigate RQ1b (whether prompts affect students’ value of drawing), we first compared reported drawing value 
between conditions. A Mann-Whitney test showed a higher frequency of drawing value, U = 8,623, p = .003, for the 


TABLE 2 _ Descriptive statistics of demographics organized by condition 


Control condition (N = 189) Drawing condition (N = 129) 

N % N % 
Year in school - first-year 1 0.5 3 2.3 
Year in school — sophomore 70 37.4 83 64.3 
Year in school — junior 74 39.6 25 19.4 
Year in school - senior 26 13.8 6 4.6 
Gender - male 141 75.4 101 78.3 
Gender — female 29) 15.5 14 13.1 
Prior experience in a flipped classroom 122 65.2 95 73.6 
Major — electrical/computer engineering 154 82.4 98 76.0 

Mean SD Mean SD 
Number of prior math courses taken 4.0 1.3 4.3 1.5 


Note: Percentages do not add up to 100% due to missing survey data. 


10 JEE ‘WU ETAL. 


drawing condition (M = 3.952, SD = 1.058) than the control condition (VM = 3.602, SD = 1.021). Then, we compared dif- 
ferences in drawing value over time for the students in the drawing condition. A repeated-measures ANOVA showed a 
main effect of drawing value, F(2, 210) = 3.860, p = .023, fig = .035. Compared to the pre-survey (M = 3.660, 
SD = 0.925), students reported valuing drawing more at the mid-survey (M = 3.924, SD = 1.044) and post-survey 
(M = 3.906, SD = 1.083). Hence, in regard to RQ1b, we found that students in the drawing condition reported valuing 
drawing as a problem-solving strategy more after receiving drawing prompts compared to their reported value of 
drawing before prompts and compared to students in the control group. 


3.2.1 | Exploratory analysis: Problem-solving strategies on specific problems 


We additionally explored how drawing prompts for specific problems may affect use of drawing for those problems (Q1c). 
Specifically, we qualitatively compare trends in strategy checkbox data, which we only collected from students in the 
drawing condition. As shown in Figure 5, a higher proportion of students used drawing to solve the given problems when 
they received drawing prompts (left, in solid blue) than when they do not receive prompts (right, in blue stripes). When 
prompted to draw, most students reported using drawing as a problem-solving strategy (78.6-92.2%), except for Class 
6 Q19 (31.8%), while under half of students reported using drawing to solve problems without prompts (14.0-45.0%), 
except for Class 4 Q9 (69.8%). Recall that even for problems without prompts, the instructor expected students to use 
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FIGURE 3 Students’ reported drawing use on surveys by time of survey (pre, mid, post) and condition (drawing on left, control on 
right) 
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drawing to solve the targeted problem. In regard to exploratory Qic, these findings suggest that when prompted to draw 
in a given problem, students were more likely to use it as a problem-solving strategy than when unprompted. 


3.3 | Differences in exam performance 


Finally, we investigate differences between conditions in conceptual understanding (RQ2a) and procedural knowledge 
(RQ2b) by comparing exam performance on conceptual and procedural questions, as summarized in Figure 6. In our 
study, students in both conditions scored near 90% out of a total 100% and exam scores were not normally distributed. 
Hence, we used Mann-Whitney tests to compare differences between conditions below. 

To investigate RQ2a (effects on conceptual understanding), we conducted a Mann-Whitney test with condition as 
the independent factor and score on conceptual exam questions as the dependent measure. Results showed significant 
differences between condition, U = 10,455, p = .044, such that the drawing condition (VM = 89.7%, SD = 7.6%) out- 
performed the control condition (MV = 86.9%, SD = 10.4%). In sum, drawing prompts enhanced conceptual 
understanding. 

Next, we investigated RQ2b (effects on procedural knowledge) using a Mann-Whitney test with score on procedural 
exam questions as the dependent measure. We found no significant differences between conditions, U = 11,299, 
p = .339. That is, exam performance on procedural knowledge did not differ between the drawing condition 
(M = 90.7%, SD = 7.7%) and control condition (M = 89.9%, SD = 7.9%). In sum, drawing prompts did not affect 
procedural knowledge. 


4 | DISCUSSION 


This study investigated the effects of implementing drawing prompts in an active learning engineering classroom to 
help students engage in drawing, a practice used by professional engineers. Results showed that drawing prompts 
increased students’ reported use and value of drawing as a problem-solving strategy (RQla and RQ1b). Specifically, we 
found that students who received prompts used drawing more frequently and perceived drawing as more valuable in 
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the middle and end of the semester, compared to the beginning of the semester and to students who did not receive pro- 
mpts. Recall that we only implemented drawing prompts in video lectures and a small subset of 14 of 590 problems, 
which were provided early in the semester to guide and encourage students to draw. However, students can use any 
strategy that they prefer. In fact, our exploratory analysis of students’ problem-solving strategies for specific questions 
showed that, on average, most students in the drawing condition were likely to draw when prompted to draw and only 
some students drew when not prompted. Hence, it is more likely that across the 590 problems that students solved over 
the entire semester, most students would have chosen not to draw. The fact that we found large-sized effects for the 
increased use and value of drawing at the middle and end of the semester suggests that students chose to engage in 
drawing as a valued problem-solving strategy throughout the course. 

Furthermore, results showed that the drawing condition outperformed the control condition on exam questions 
that assessed conceptual understanding (RQ2a), but not on questions that assessed procedural knowledge (RQ2b). This 
finding aligns with prior research on drawing, which shows that tests of conceptual understanding are more sensitive 
to the effects of drawing prompts than tests of simple knowledge (Leutner & Schmeck, 2014; Van Meter & Garner, 
2005). These results suggest that implementing prompts to draw may engage students in conceptual problem-solving 
without affecting procedural knowledge. 

Taken together, our findings suggest that drawing prompts in active learning classrooms may help students 
engage in drawing to solve practice problems and thereby enhance students’ understanding of the underlying con- 
cepts. Building on the ICAP framework (Chi & Wylie, 2014; Streveler & Menekse, 2017), we designed drawing 
prompts so as to change students’ cognitive engagement with concepts covered in the course. Drawing requires stu- 
dents to constructively generate coherent drawings that depict how concepts relate, which can help students clarify 
relationships that may be unclear in their minds (Bobek & Tversky, 2016). Furthermore, when implemented in a 
classroom that promotes active learning with peers and instructors, drawing prompts can ask students to compare 
their drawings with others, which allows them to interactively discuss and construct ideas with peers (Prain & 
Tytler, 2012; White & Pea, 2011). Hence, engaging in drawing individually or collaboratively may help students solve 
the given problems and learn the underlying concepts. This may explain why, even though we did not require stu- 
dents to draw, students reported increased use and perceived value of drawing as a problem-solving strategy later in 
the semester. 

Furthermore, our exploratory results showed that implementing drawing prompts in specific problems helped 
students use drawing as a problem-solving strategy. Students were more likely to draw when a specific problem 
prompted them to draw compared to other problems where they received no prompts to draw even though the 
instructor expected students to do so. Recall that the instructor focused on drawing in video lectures throughout the 
semester but only added drawing prompts to 14 in-class problems that targeted difficult threshold concepts in electrical 
engineering (Buck et al., 2005; Mercorelli, 2015; Shearman et al., 2009). These prompts may have helped students draw 
to understand the difficult concepts instead of choosing to plug-and-chug numbers. Prior studies have not examined 
the effects of drawing prompts on learning outcomes in engineering courses even though students report that instruc- 
tors often prompt them to draw in their courses (McNeill et al., 2016). Interview studies have investigated how students 
draw when solving problems (Cardella et al., 2006), but no prior work has examined how students draw in classrooms 
and how instructional prompts to draw may affect students’ choice to draw or to use other strategies. Hence, to the best 
of our knowledge, this study is the first to show that drawing prompts are an effective instructional practice that may 
help students engage in drawing as a problem-solving strategy in engineering classrooms. 

Our results further showed that drawing prompts may enhance conceptual understanding and address the gap 
between professionals and novice students in introductory-level engineering courses. In our study, the drawing prompts 
led to gains in conceptual understanding, suggesting that students may have solved problems conceptually rather than 
procedurally. In contrast to the plug-and-chug method often used by novices (Bergqvist, 2007; Lithner, 2003), profes- 
sional engineers often draw on paper as a low-tech strategy to conceptually solve a variety of problems (Kavakli & 
Gero, 2001; Purcell & Gero, 1998). Drawing aligns with recommendations for engineering education to minimize math- 
ematics and emphasize visual representations of the underlying concepts (Bergsten et al., 2017; Otung, 2001). Yet, prior 
work has not investigated whether novice engineering students would benefit from drawing to solve problems as pro- 
fessionals do because they struggle to draw without instructional support (de Vere et al., 2011; Leutner & 
Schmeck, 2014). Hence, our findings provide some preliminary evidence that implementing drawing prompts may be 
an effective instructional practice to facilitate conceptual problem solving in the introductory-level engineering 
classroom. 
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4.1 | Implications for engineering education 


Our findings have several implications for research in engineering education. First, we showed that drawing pro- 
mpts are a productive avenue of research, particularly in introductory-level engineering courses. Prior research 
shows that drawing is a valued professional practice, but traditional instruction rarely helps students to draw 
during problem solving in engineering courses (Litzinger et al., 2011; Streveler et al., 2008). Our study suggests 
that drawing prompts can provide this support by showing students how professionals use drawing to solve 
problems and guiding students on how to solve specific problems themselves by drawing. To further help stu- 
dents engage in such practices, we encourage additional investigations on the effects of drawing prompts in 
classrooms, which can inform how best to support drawing as a problem-solving strategy in engineering 
education. 

Second, we showed how to use the ICAP framework to identify effective active learning interventions. Prior 
research on active learning has focused only on comparing active versus passive interventions and encouraged the use 
of active learning activities without identifying what aspects of a specific activity make it effective in engineering 
courses (Bishop & Verleger, 2013; Kerr, 2015; Streveler & Menekse, 2017). The ICAP framework can extend this work 
by identifying how engaging students in constructive and interactive activities can further enhance active learning 
classrooms. In our study, we isolated the effects of drawing prompts on students’ learning outcomes by comparing an 
active learning engineering classroom with or without drawing prompts. Specifically, we differentiated active learning 
activities by levels of cognitive engagement in the ICAP framework as suggested by engineering education researchers 
(Streveler & Menekse, 2017). The ICAP framework helped explain how drawing may engage students constructively 
and interactively when combined with problem-solving activities that may only engage them actively. These findings 
extend research on active learning by demonstrating how to identify a specific instructional practice as effective in 
enhancing an existing classroom with active learning activities. Additional research should use the ICAP framework to 
test the effects of other constructive and interactive activities that increase cognitive engagement (e.g., self-explanation, 
teaching peers, and writing design reports) to determine which types of active learning activities are effective at 
enhancing learning in engineering courses. 

Our study also has several practical implications for instruction in engineering education, particularly on the 
development of active learning activities. First, our study suggests that instructors can enhance active activities, such as 
practice problems in an engineering classroom, by implementing constructive and interactive activities that increase 
cognitive engagement, such as drawing prompts. Adding activities to increase cognitive engagement may help students 
engage with content conceptually, particularly in an introductory-level engineering class where students are likely to 
use plug-and-chug strategies to solve problems procedurally. Specifically, our findings suggest that, if instructors aim to 
increase conceptual understanding, they should not only augment or replace passive activities with active activities but 
also add constructive and interactive activities to their classrooms. 

Second, this study showed how to design text-based prompts for an instructional practice that is relatively easy 
to implement in a variety of engineering courses. To replicate our drawing prompts in traditional or virtual lec- 
tures, instructors can demonstrate how they draw to solve a problem and end with verbal encouragement to do 
likewise. Then, they can add a sentence that prompts students to draw on problems in homework assignments, 
classwork, and/or exams to provide guidance on how, why, when, and what students should draw when solving 
problems (Leutner & Schmeck, 2014; Valanides et al., 2013). Because students only need a pen and paper, 
drawing prompts can be implemented in a variety of materials from paper worksheets to adaptive technologies 
that facilitate problem solving. Such drawing prompts can amplify course materials to promote instructional prac- 
tices so that students receive support when they access the materials, even when an instructor is not immediately 
available. 

Finally, we found that students benefit from multiple, targeted prompts to draw. Because students can choose to use 
any strategy in the classroom, novice students may choose the plug-and-chug method to solve problems quickly even 
though it can impede their understanding of the underlying concepts (Bergqvist, 2007; Lithner, 2003). Given that stu- 
dents often struggle to draw, instructors should provide not only brief announcements and reminders to draw before 
problem-solving sessions but provide guidance on what to draw when solving problems until students learn to use 
drawing as a problem-solving strategy. Our results suggest that students were more likely to draw when prompted in 
specific practice problems, and, thus, students may need repeated, targeted prompts to draw as they solve problems in 
engineering classrooms. 


4.2 | Limitations and future directions 


Our study should be considered in light of the following limitations. First, while we consider the ecological validity of our 
study a strength, it is limited by its use of a quasi-experimental cohort comparison, similar to many other studies that 
have compared active learning classrooms to other instructional designs (Bishop & Verleger, 2013). We controlled for dif- 
ferences using demographic information, but students enrolled in different semesters may have additional differences that 
were not measured in this study (e.g., motivations, cognitive abilities, and collaboration patterns). Thus, the results of this 
study may not be generalizable to other populations without additional experiments that use random assignment of 
students to conditions or use quasi-experimental designs that control for other possible a priori differences. 

Second, we found nonrandom differences in missing survey data between semesters and students’ reported use of 
drawing. Because surveys are voluntary, there may be attrition and nonresponse biases in missing data. However, recall 
that the instructor provided an extra incentive for the post-survey of the drawing condition, which increased the 
response rate of those students. This incentive likely increased this response rate, particularly from students who used 
drawing less often, as our missing data analysis indicated respondents were more likely to report higher drawing use. 
Therefore, the true difference between conditions on students’ use of drawing may have been larger than the effects 
reported here. 

Third, we found a relatively small difference in performance on conceptual exam questions between the drawing 
and control conditions. Because we conducted our study in a classroom that already implemented multiple active 
learning activities, the average exam scores for both conditions neared 90%, which suggests a ceiling effect. Hence, 
future studies with drawing prompts in other active learning classrooms or additional measures of conceptual 
understanding are needed to determine how drawing prompts facilitate conceptual problem solving. 

Fourth, we did not investigate the effects of drawing prompts for specific populations of students. Prior work has 
found that certain instructional practices can particularly support females and minorities in engineering, such as 
building spatial skills that help students better learn with visuals (Hill, Corbett, & St. Rose, 2010). Students in our study 
were mostly male students, in line with the demographics of engineering majors at our university and in the broader 
population. Due to the small proportion of female students in our study, we were unable to identify significant differ- 
ences between genders in perceptions of drawing or learning outcomes. However, there was a trend that females used 
drawing more and valued drawing as a problem-solving strategy more than males. The increased drawing use may 
align with exploratory studies that suggest females are more likely to follow instructions (e.g., Bairaktarova, 2017). 
However, additional research should explore whether drawing prompts address a gap in instruction, particularly for 
female students in introductory engineering courses who report drawing as valuable for problem solving. 

Fifth, we only provided drawing prompts on selected problems during class. We selected problems based on log 
data from students in our study and classroom observations of how instructors helped students solve problems when 
answering questions one-on-one. However, students may need support on other types of problems or need additional 
drawing prompts to engage with problems without one-on-one instructor support. Hence, future work should deter- 
mine whether drawing prompts for other types of problems are effective and what number of drawing prompts are 
optimal for novice engineering students in the active learning classroom. 

Finally, our study did not determine how students interacted with prompts and with one another to identify mecha- 
nisms that may underlie students’ learning outcomes. Particularly, we did not assess whether students constructed and 
reflected on drawings individually (ie., constructive engagement) or discussed their drawings with peers or instructors 
(i.e., interactive engagement). Because students received feedback only on their final answers to problems but not on draw- 
ings, it is possible that drawing prompts were effective because students gave feedback to one another's drawings through 
interactive engagement with their peers. Hence, future studies should investigate the nature of classroom interactions when 
students draw and determine whether drawing prompts are more effective as an individual or collaborative activity. 


5 | CONCLUSION 


Our study makes several important contributions to instructional practices in engineering education. First, we shed light 
on which types of active learning activities are effective in engineering courses. Specifically, our study suggests that pro- 
viding instructional prompts to draw can help students engage in drawing as a problem-solving strategy in the context of 
an active learning classroom. Second, we show that drawing prompts may address a gap between how professionals and 
introductory-level undergraduates solve problems. The findings suggest that drawing prompts helped students in an 
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undergraduate engineering course engage in conceptual problem solving as professionals do throughout the semester, 
even after students stop receiving drawing prompts that guide them in solving specific problems. Finally, we provide theo- 
retical insights into how increasing cognitive engagement makes an active learning activity more effective. Specifically, 
our study shows that prompting students to draw is an effective instructional practice that can enhance an engineering 
course that already implements other active learning activities. Our findings provide practical recommendations for engi- 
neering instructors on how to implement a low-tech instructional practice that can enhance their active learning class- 
rooms in the digital age. Specifically, we suggest that providing a simple text-based prompt to draw in lectures and 
classroom problems can help students develop important engineering practices that help them solve problems on paper. 
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EXAMPLE EXAM QUESTIONS THAT FOCUS ON CONCEPTUAL UNDERSTANDING OR PROCEDURAL 


KNOWLEDGE 
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